Bug: localscore seems only use half of the cpu threads

[fengwang]

Contact Details

No response

What happened?

I tested localscore on my home server, the test result is at https://www.localscore.ai/result/417.
This server has two E5-2699 v3 CPUs installed, but I noticed only first half of the available threads are utilized, as is shown in the attached htop resource monitor screenshot.

Version

llamafile v0.9.2

What operating system are you seeing the problem on?

Linux

Relevant log output

see to https://www.localscore.ai/result/417

[cjpais]

I will take a look at this soon, I think there might be some code which is used to determine the threads, and it might be avoiding hyperthreading or similar

Mainly would want to check if it improves or reduces performance.